Correlating Topic Rankings and Person Rankings to Find Experts
نویسنده
چکیده
Expert search is about finding people rather than documents. The goal is to retrieve a ranked list of candidates with expertise on a given topic. The task is studied in the context of the enterprise track. We describe an approach that compares topic profiles and candidate profiles directly. These profiles are not based on unordered sets of documents, but on ranked lists. This allows us to differentiate between documents that are highly related to a topic or a candidate and documents that are only marginally related. The ranked lists for topics and candidates are obtained by simple retrieval queries. The correlation between the ranked list of documents for a topic and the ranked list for a candidate is used as an indicator of the candidate’s expertise on the topic. We study different ways to rank documents for the candidate profiles as well as various ways of comparing the document and candidate based ranked lists. Experiments show that starting from the right candidate profiles, reasonable results can be obtained. Furthermore, it seems important to take a correlation measure that takes into account the orderings of documents in both the candidate profile and the documents profile.
منابع مشابه
Evaluation of Ranking Similarity in Ordinal Ranking Problems
In ordinal ranking problems objects, alternatives, products, services, etc. are ranked by several experts and the goal is to convert a set of (generally different) rankings into the final group consensus ranking. However, this goal depends on a degree of agreement among rankings. With random rankings one cannot expect to get meaningful consensus, but if rankings are „close“ and represent agreem...
متن کاملRankings of Students Based on Experts' Assessment of Levels of Verification of Learning Outcomes by Test Items
The paper presents methods of preparing students’ rankings based on the results of final secondary school examination test in mathematics in Poland. The currently used method is based on the percentage of earned points and does not take into account levels of acquirement of learning outcomes by students. The data used in this article contains results of students who earned the same number of po...
متن کاملIdentifying salient topics for personalized place similarity
The ability to find similar places is an important component to geographic information retrieval applications as varied as travel recommendation services, marketing analysis tools, and socio-ecological research. Using generative topic modelling on a large collection of place descriptions, we can represent places as distributions over thematic topics, and quantitatively measure similarity for pl...
متن کاملAn expert-based job exposure matrix for large scale epidemiologic studies of primary hip and knee osteoarthritis: The Lower Body JEM
BACKGROUND When conducting large scale epidemiologic studies, it is a challenge to obtain quantitative exposure estimates, which do not rely on self-report where estimates may be influenced by symptoms and knowledge of disease status. In this study we developed a job exposure matrix (JEM) for use in population studies of the work-relatedness of hip and knee osteoarthritis. METHODS Based on al...
متن کاملPatterns of Decision Making in Kidney Allocation Problems
Experts in the field of organ transplantation had to rank order a set of 32 patients according to their priority in receiving a donated kidney. The patients were described by the five characteristics that are incorporated in the kidney allocation algorithm applied by “Eurotransplant”. The priority rankings as defined by the experts were analyzed and patterns of decision making identified in the...
متن کامل